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This is an analysis of the additivity of the entropy of thermodynamical systems with finite heat 
baths. It is presented an expression for the physical entropy of weakly interacting ergodic systems, 
and it is shown that it is valid for both the microcanonical (constant energy), the Boltzmann-Gibbs 
canonical (infinite heat bath) and the Tsallis (finite heat bath) ensembles. This physical entropy 
may be written as a variant of Tsallis entropy. It becomes an additive function after a suitable 
choice of additive constants, in a procedure reminiscent to the solution presented by Gibbs to the 
paradox bearing his name. 
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I. INTRODUCTION 

The non-extensivity is one of the major features of Tsallis entropy and perhaps the reason for most of the criticism 
it receives. This property was recognized in the very first paper |J where the generalized entropy has been proposed 
in its discrete form 

where q is a real constant and p(X = Xi) is the probability distribution of a discrete random variable X that takes 
value on {x±, . . . ,xn}. Tsallis obtained the non-extensive (non-additive) relation 

S q (X, Y) = S q (X) + S q (Y) - (q - l)S q (X)S q (Y) (2) 

computing the entropy of the joint distribution of two independently distributed random variables X and Y, Since 
then, the words "extensive" and "additive" have been loosely used as synonymous in the literature about Tsallis 
statistics However, following Touchette's Q guidelines for the usage of these terms, the property expressed by 
Eq. (g) is called here "non-additivity". 

In a recent paper, Abe || has shown that, for composite systems resulting from the joint observation of two 
independently distributed sub-systems, the "physical entropy" is additive at the macroscopic level, even in the context 
of Tsallis statistics, where by "physical entropy" he means the function (Renyi entropy) 

_ ln(l + (1 - g)S g ) _ HZlMX = Xi)] 9 ) w 

s — q - l^q ' (3) 

where S q is the Tsallis entropy. 

Power-law (Tsallis) canonical distributions have been connected to the finitude of the dimension of the phase space 
of the heat bath in {§, § and §]. 

The issue of additivity within Tsallis statistics has been addressed in the scientific literature up to now assuming the 
joint observation of independent random variables as done in the derivation of Eq. (||). Regardless of the validity of 
this rule for non- interacting systems and for "weakly interacting systems" in the thermodynamic limit, the same can 
not be generally applied for finite thermodynamic systems. We say that two systems are in weak interaction when the 
Hamiltonian of the composite system is just the sum of the Hamiltonians of its sub-components, -ffi+2 = Hi + H2. As 
a consequence, the internal energy (U — J Hpdqdp) of such a system in an equilibrium state p is an additive variable. 

Consider, for instance, the observation of the energy. When one joins (through weak interaction) two independent 
sub-systems, A\ and A2, the distribution of the energy of the composite system A, (Ea — Ea 1 + Ea 2 ), is given 
by the convolution of the sub-component's distributions, p(Ea) = p(Ea 1 ) <8> p(Ea 2 ), which is generally different 
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from the distribution of the joint observation of Ea 1 and Ea 2 , p(Ea 1 ,Ea 2 ) = p(Ea 1 )p(Ea 2 ). In other words, when 
observing Ea, it is not necessary to know how much of it comes from system A\ or A 2 , but only that the sum of 
these contributions adds up to the observed quantity. In addition to this, even the range of the energy value of 
each sub-system changes upon the composition: If each separate sub-system initially has internal energy equal to Eq, 
after their merging the composite system will have energy equal to 2Eq and the energy of each sub-system will now 
fluctuate in the interval [0, 2E ). Therefore, the joint distribution of the simultaneous observation of two independent 
systems A\ and A 2 does not represent the composite thermodynamic system A\ + A 2 . Since the distribution of a 
sum of independent random variables is a "convolution" of the distributions of the component variables, the additivity 
of the energy implies that the correct distribution for the composite system shall be obtained through a convolution 
operation. Only in the thermodynamic limit, when the sub-systems become infinite, the resulting distribution will 
factor into the product of the component distributions. Moreover, it can be rigorously proof that for systems in weak 
interaction the Boltzmann-Gibbs canonical distribution (exponential) is the only one for which the convolution of the 
components equals their product. 

We will derive a physical entropy function S that is additive at the equilibrium distribution even for finite systems. 
For a given system A resulting from a weak combination of two sub-systems A\ and A%, (all of them in equilibrium), 
the entropy function S satisfies the additive rule S(A) — S(Ai) + S(A 2 ). We will explicitly evaluate S for canonical 
ergodic systems. This analysis will be based on the canonical ensemble theory of ergodic systems as presented by 
Kinchin ||, whose basic elements we recollect in Section II. The present work is a follow up of the study started in || 
where it was presented a one-to-one connection between the canonical distribution and the form of the entropy, and 
the Tsallis entropy was derived from first principles. This alternative approach for Tsallis statistics has been already 
used by Andrade et al. to formulate a molecular dynamics scheme for Hamiltonian systems exhibiting power-law 
distributions, generalizing the extended Hamiltonian approach presented by Nose j8). This setup was also used by 
Adib et al. [g| to analyse the statistical behavior of systems with homogenous Hamiltonians. 



II. ERGODIC SYSTEMS 



For a generic system with Hamiltonian H = H (q, p) and phase space S, let V(E) denote the volume of the region 
of 5 where H(q, p) < E, Q(E) = dV(E)/dE be the structure function M, and (3(E) be the function 

/?(£) = ^inO(£). (4) 

The distribution on the surface of constant energy (S(i?)) that is invariant under the motion of the system is called 
microcanonical and has density given by (see Chapter II of J(|) 

where ||V-ff(q, p)|| is the norm of the gradient of the Hamiltonian _ff(q, p). 

For a system A which is the weak combination of two sub-systems Ai and A 2 (denoted by A — A\ l±l A 2 ), we have 
that -ff(q,p) = H\(q 1 ,p 1 ) +^2(q2:P2) with no interaction term between A\ and A 2 in the Hamiltonian, i.e., the 
energies of the sub-systems are additive. In that case the canonical distribution in Si, when the total energy of the 
composite system A is equal to E, is given by the density function J(| 

n 2 (£-ffi(q,p)) 

pi(q ' p) = — m — • (6) 

The structure function of A satisfies the convolution relation 

si(E) = [ ni(£)n 2 CE-£K- (?) 

Jo 

Observe that the microcanonical distribution on Hi(Ei) is the conditional distribution of p\ obtained by fixing the 
value of Hi (q, p) = E\ , which results in 

Pi mC) (q>P) = n lT? Mijrr 7 \TT' ( 8 ) 

S2i(£l)||V.ffi(q,p)|| 



3 



It has been shown in Q that the form of the canonical p\ depends on the value of the parameter q 2 , which is related 
to (3 2 {E) through the expression 



d ( 1 



dE \(3 2 {E) 



= 92-1- (9) 



When q 2 = 1, p\ is an exponential (Boltzmann-Gibbs) and, when q 2 ^ 1, p\ is a power-law (Tsallis) distribution. 
Identifying system A 2 with the heat bath B and integrating Eq. (||) with the initial condition ^(O) = we get that 

(l 2 (E) = C E l '^- l \ (10) 

where Co is a constant, and consequently 

We are going to consider that the elementary systems appearing from now on have structure functions in the form 
Q(E) — CE 1 /^ 1 ^, with specific constants C and q for each one. The parameter q, which is a signature of the 
system's phase space geometry, may vary from system to system. Indeed, Almeida et al. |l^| have showed that the 
weak composition of two systems O and B, with parameters qo and gg, respectively, results in a system A with 
parameter qA given by 



1A qo QB 



1A ~ 1 Qo ~ 1 Qb ~ 1 

and that the temperature definition obeying the theorem of equipartition of energy leads to the expressions 



(12) 



kT = ( ) E A (13) 

< Ho > (14) 

< H B > . (15) 



qa - 


i 


QA 




qo - 


i 


qo 




qB - 




qs 



Let's consider a weak combination of independent canonical sub-systems Aj, each one having an observable sub- 
system Oi — 0{Ai) and a heat bath B% = B(A{). The observable and the heat bath of the composite system A 
are, respectively, the weak combinations of the observables and of the heat baths of the sub-systems, i.e., A = WiAi, 
0{A) = &iO(Ai), and B(A) = l±ljB(j4j), Identifying the observable part 0{= 0{A)) and the heat bath B{= B(A)), 
respectively, with the systems A\ and A 2 in Eq. (|6|) , we write the canonical distribution of A as 

n B (E A - Hp) 

Po[Ho)= n A (E A ) ' (16) 

where E A is the total energy of A , Hq is the energy of its observable sub-system, and fl A and Sla are the structure 
functions of the total system A and of its heat bath B, respectively. Writing po in the usual Tsallis density form 

p{H ) = Po(Ho) = Po[l- (QB - l)(3Ho] 1/{qB - 1] , (17) 

we have that 

Vb(E a ) 

p0 = 04^) (18) 



and 



P = 0b{Ea) = J^)e-a (19) 



Moreover, the equivalent to Eq. ( |12| ) reads as 

qA qo qB 



qA -l qo - 1 qs - 1 ' 
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where qA, qo and qn are the parameters q of A, O and £>, respectively. 
Applying Eq. ( |12| ) recursively to A, O and £? we get the relations 



<21 » 



9o Id 



and 

98 \ - <7e 



98-1 ^ g Bj - 1 



III. PHYSICAL ENTROPY 



For a system with Hamiltonian H and probability density function p let U be the internal energy, W be the work 
of the external forces and Q be the heat supplied to the system. In terms of the microscopic functions we have that 



U = J Hpdqdp. (24) 

The first law of thermodynamics states that 

6U = SW + 8Q. (25) 
Computing the variation SU from its microscopic definition, Eq. (gj), we get that 

SU = J [SH)pdqdp + J H(Sp)dqdp. (26) 

The first term on the right hand side of this equation is the variation of the work SW and so we get that 

SQ = J H(5p)dqdp. (27) 

The second law of thermodynamics states that there are an exact differential functions S, called entropies, such that 

SS = ^SQ, (28) 

where T, the integrating factor, is a temperature scale. 

As pointed out in a previous work || , the functional form of the physical entropy is determined by the canonical 
distribution: Given a canonical density function in S, p = f(H), with a non-negative monotonic function fix) defined 
for x > 0, the functions (entropies) that satisfy the second law of thermodynamics are given by 

S(p) = ^F(p)dqdp (29) 

with 

F(p) = ^J Q P f- 1 (m + TpP, (30) 

where ip is an arbitrary constant. As will be seen later, it is convenient to choose i\> = —k, where k is the Boltzmann 
constant. 

Applying the above procedure to the Tsallis density function 

p{H) = Po [l-{q B -l)PH] 1/[qB - 1 \ (31) 
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where {qs — = l/E is the inverse of the total energy of the system, considering that 



Po = P(0) = U[l - («b - l)[3H] 1/iqB - 1} 



dqdp 



is constant, we get the function 



£(p) = 



1 



96 7h \Po 



(32) 



(33) 



which is not the entropy yet, because of the imposed condition that po be constant. Collecting and rearranging terms 
we get the alternative expression 



+ ( 

This expression may be written also as 



( i 



\qeTf3 



where 



Sts(p/po) = 



Po S TS (p/po) + 



( 1 



\qsTf3 



IB ~ 1 J~ 



in 



dqdp 



(34) 



(35) 



(36) 



is the Tsallis entropy evaluated at the ratio p/po- Observe in Eq. (|35|) the splitting of the roles played by the density 
function form, p/po, and by the normalization value po- 

Now, considering that both p and po vary along the process, the evaluation of S£ will produce the sought expression 
for the entropy. From Eq. (|33|) we have that 



8£ 



T (<3B-l)/3 



/ \<IB-1 

Je {-£) (5 P )dqd v + 



(37) 



Substituting the expressions for p and po, and considering the temperature expressions Eqs. (p^)-(p^) we get that 



If 1 
8£ = - /_ H(Sp)dqdp + M(lnpo) = + kSQxipo), 



and from it we conclude that 



and so the generic entropies are 



5S=-5Q = 8£-k8(lnp ), 



S(p) = £(p)- kin po + C, 



where C is an arbitrary constant. 

For a fixed value of D = qsT(3, the maximization of S(p) under the conditions 

j pdqdp = 1 , 
J H pdqdp = U, 

and 

Po = p(0), 

results in the Tsallis density function p(H) given by Eqs. (pi]) and (b2). 



(38) 



(39) 



(40) 



(41) 
(42) 



(43) 
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A. Additivity of £ 



Let's compute the explicit value of £a(p) for a system A(= O W B) whose canonical distribution on So, p(Ho), is 
given in Eq. ([l7]). From a direct integration we get 



A) 



dqdp = 



1 - 



< H > 



E A 



(44) 



where we adopt the notation < / >= J„ o fpdqdp for the average of a generic function /. 
From Eqs. (|l9|) and (13) we get that 



1 



1A 



Substituting Eqs. (H) and (E|) in Eq. 



T(q B -l)P \q A -l, 
and using Eq. (p0[) one gets that 

go 



£a{p) 



qo - 1 



(45) 



(46) 



Using the combination rule for the go's, Eq. (|22]), we observe that under weafc combination of sub-systems the function 
£a is additive. In general, if A is a (weak) combination of N sub-systems A4, i = 1, . . . , N, (A = A\ \t)Az !±l . . . kfcl A^), 
all at the same temperature T, then 



iV 



i=l 

Notice that £ A {p) does not depend on the parameter gg, hence Eq. 
Gibbs) , which can be also verified through a direct evaluation of Eq. (|£ 
together with Eq. 

£ A (p) 



(47) 

is valid in the limit case q e — » 1 (Boltzmann- 
with p = po exp(— f3H). Observe that Eq. (jT 
leads to the relation between £a, the internal energy U =< Ho > and the temperature T, 

U 
T' 

Substituting the alternative forms of £{p) into Eq. ( fie] ) we obtain 

qo 



(48) 



and 



S(p) = k 



Sip) 



qo - 1 

U 
~~ T 



- fclnpo + C 



k In po + C. 



This last expression was also obtained through a different route by Potiguar and Costa 

Notice that the constants qs and j3 appearing in Eq. (|34|) are associated with the heat bath and that 



1 



qeTp 



k 



QA 



qA-1 

go 

qo-l 



gB - 1 

gg - 1 

gB 



(49) 
(50) 

(51) 
(52) 



is determined by the constants qo and gg. From this last equation, we see that the commonly used relation kT/3 = 1 
is valid only in the limit qs — * 1, i.e., in the Boltzmann-Gibbs statistics. This fact has been overseen by some authors 
who inadvertently adopted kT = 1//3 within Tsallis statistics, which might have led to misleading results. 



B. Microcanonical ensemble 



The microcanonical ensemble is represented by a constant energy Ho and its density function in this surface So is 



Hence, we may consider that in Eq. ([53]) po — {&o) 1 and obtain from Eq. ( ^9| ) that 



S{p^) = kln [VLo(Ho)] 



qo 



C 



(54) 



,qo - 1 

which is the Boltzmann entropy for the microcanonical ensemble plus constants. 

C. Boltzmann- Gibbs canonical ensemble 

The Boltzmann-Gibbs canonical ensemble considers an infinite heat bath, which is represented by the limit condition 
q B — > 1 keeping f3 fixed. Taking this limit in Eq. (|T^ ) and in either of the Eqs. (|33|) or (^) we arrive at 

p{H ) = P0 exp(-f3H o ) (55) 

and 

£{p) = ^ {l - ^ P Hp)dc l dp + ln(po) | - k, (56) 
from which, considering also that in the limit qs — > 1 we have l/(T{3) = k (see Eq. ( |52|) below), we get that 

S = £{ P ) -kln(p ) + C = -k J pln(p)d( l dp + C (57) 
is the Boltzmann-Gibbs-Shannon entropy plus an arbitrary constant C. 

D. Additivity of fclnpo 

Let's consider that the system A is the weak combination of n identical sub-systems Ai,i= 1, . . . , n, which by their 
turn are the weak combination of an observable Oi and a heat bath Bi. Let q, qi and qi be the g-parameters of the 
Ai, Oi and Bi, respectively. Therefore, we have that the parameters for the system A, its observable part O, and its 
heat bath B are respectively qA, qo and qs, and they satisfy the relations of Eqs. (|2l|)-(|23|), i.e., 

qA lAi q 



q A -\ l^q A .-l q-l 



^T = E^T = «^ L T ( 59 ) 
and 

" y;-®4=n-» (60) 

1 4" <7& - 1 <72 - 1 V ; 



?B - 1 ^ 3Bi — 1 92-1 
Computing the structure function of the system A using Eq. (Q) we obtain 



n A (E A ) = n (E A )(l B (E A )E A yg ° / \ gB J (61) 



(j-l) 

Therefore, 



Recursively applying Eq. ([?]) to compute Qq(Ea) we get that 



M^) no(EA)E A T(^ I )r{ 1 ^ T ) 
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where Co is the multiplicative constant appearing in the structure functions ft en ■ Plugging (|63|) into ( |62| ) we obtain 



Po 



r 


' 1A \ 




r 




K qs-i) 



C T 



91-1 



^F 1 



>From Eq. ( |l3| ) the total energy in terms of the temperature and q is 



E A = kT 

>From these two last equations we get that 

— A: In po 



QA — i 



— nkT 



k In 

+kn 
+kn 
+kn In 



( 71 12 

\q-2-i 



nq 
9-1 



qx 



91-1 
9i 



91-1 

c r 



ln[n] 



In 



fcT 



9-1 



9i 



91-1 



(64) 
(65) 

(66) 

(67) 
(68) 
(69) 



The terms in Eqs. ( |68| ) and fl69j ) are additive since they are linear in n, but the terms in (|66j) and (p7J) are non-additive. 
We can eliminate this non-additivity by taking the constant C appearing on Eq. ( po| ) equal to the negative of the 
sum of all terms on the right hand side of Eqs. (66)- ( |69| ) that depend, besides of n, only on the parameters related 
to the smallest system sub-components, viz., q, qi, 92 and Co. This adequate choice of the constant C is analogous to 
the solution presented by Gibbs to the paradox bearing his name. In this way, we are left solely with the only term 
depending on T, 



-fclnpo + C = kn 



9i 



91-1 



ln[T] 



qo 



qo 



T mm. 



(TO) 



Combining Eqs. (p0|), ( (46| ) and ( |70| ) the resulting entropy function becomes 



S 



qo 



[l + ln[T]] = ^[l + m[T]] 



,9o~l 

Since the temperature T is an intensive variable and the internal energy is additive, this entropy form is additive. 



(71) 



IV. CONCLUSIONS 



We have seen that both the microcanonical and the classical canonical (Boltzmann-Gibbs) distributions can be 
obtained from the Tsallis distribution. We have obtained also an expression for the "physical entropy" of weak- 
interaction systems with finite heat baths (qj3 ^ 1) and showed that, for systems with constant energy, it yields 
the classical microcanonical Boltzmann entropy and that when the heat bath gets infinite (qn — > 1), it becomes 
the classical Boltzmann-Gibbs-Shannon entropy. Moreover, we saw that this "physical entropy" may be written as a 
variant of Tsallis entropy plus the product of the Boltzmann constant and the logarithm of the partition function. 
In addition to this, we saw that it may be turned into an additive variable by adding appropriate constants in a 
procedure reminiscent to what was done by Gibbs to overcome the Gibbs paradox of the microcanonical entropy for 
ideal gases. 

Our results strength the physical meaning of the generalized entropy by showing that the generalized thermostatistics 
fills the gap between the microcanonical and the Boltzmann-Gibbs canonical ensembles. These results are summarized 
in the following frame: 



Ensemble 


microcanonical 


Tsallis 


BG canonical 


heat bath 




finite 


infinite 


constraint 


Hq = constant 


98 1 


q B -> 1 


density p 


PoIllVffH]- 1 


Po[1-(9b-1)/9^o] 1/(9b - 1) 


Po exp(-@H ) 


Entropy 


S = k (^r) ~ k Hpo] 
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The analysis presented here aimed at the additivity of the entropy within thermodynamic systems and it was 
not intended to contest the validity of Eq. (||), which is applicable for the original Tsallis entropy Sts under joint 
observation of independent random variables. It was also seen that when weakly combining systems the parameter q 
varies with the dimensionality of the system's phase space following the additive rule for weak interactions (Eq. (O) ), 
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